InforLorV4, Main, Exploration, bibRecord, 001943

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

Identifieur interne : 001943 ( Main/Exploration ); précédent : 001942; suivant : 001944

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

Auteurs : Ingmar Steiner [Irlande (pays)] ; Korin Richmond [Royaume-Uni] ; Slim Ouni [France]

Source :

RBID : Hal:hal-00734464

Abstract

The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approaches to facial animation can make use of sophisticated motion capture techniques, the animation of the intraoral articulators (viz. the tongue, jaw, and velum) typically makes use of simple rules or viseme morphing, in stark contrast to the otherwise high quality of facial modeling. Using appropriate speech production data could significantly improve the quality of articulatory animation for AV synthesis.

Url:

https://hal.inria.fr/hal-00734464

Affiliations:

Links toward previous steps (curation, corpus...)

to stream Hal, to step Corpus: 005201
to stream Hal, to step Curation: 005201
to stream Hal, to step Checkpoint: 001559
to stream Main, to step Merge: 001972
to stream Main, to step Curation: 001943

Le document en format XML

<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis</title>
<author><name sortKey="Steiner, Ingmar" sort="Steiner, Ingmar" uniqKey="Steiner I" first="Ingmar" last="Steiner">Ingmar Steiner</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-21766" status="VALID"><orgName>School of Computer Science and Informatics [Dublin]</orgName>
<desc><address><addrLine>UCD School of Computer Science & Informatics, University College Dublin, Belfield, Dublin 4</addrLine>
<country key="IE"></country>
</address>
<ref type="url">http://www.csi.ucd.ie/</ref>
</desc>
<listRelation><relation active="#struct-83934" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-83934" type="direct"><org type="institution" xml:id="struct-83934" status="VALID"><orgName>University College Dublin [Dublin]</orgName>
<orgName type="acronym">UCD</orgName>
<desc><address><addrLine>Belfield, Dublin 4</addrLine>
<country key="IE"></country>
</address>
<ref type="url">http://www.ucd.ie/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Irlande (pays)</country>
</affiliation>
</author>
<author><name sortKey="Richmond, Korin" sort="Richmond, Korin" uniqKey="Richmond K" first="Korin" last="Richmond">Korin Richmond</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202842" status="VALID"><orgName>The Centre for Speech Technology Research [Edinburgh]</orgName>
<orgName type="acronym">CSTR</orgName>
<desc><address><addrLine>Informatics forum, 10 Crichton Street, Edinburgh, EH8 9AB</addrLine>
<country key="GB"></country>
</address>
</desc>
<listRelation><relation active="#struct-61277" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-61277" type="direct"><org type="institution" xml:id="struct-61277" status="VALID"><orgName>University of Edinburgh</orgName>
<desc><address><addrLine>Old College South Bridge Edinburgh EH8 9YL</addrLine>
<country key="GB"></country>
</address>
<ref type="url">http://www.ed.ac.uk/home</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Royaume-Uni</country>
<placeName><settlement type="city">Édimbourg</settlement>
<region type="country">Écosse</region>
</placeName>
<orgName type="university">Université d'Édimbourg</orgName>
</affiliation>
</author>
<author><name sortKey="Ouni, Slim" sort="Ouni, Slim" uniqKey="Ouni S" first="Slim" last="Ouni">Slim Ouni</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-205127" status="OLD"><idno type="RNSR">200118295L</idno>
<orgName>Analysis, perception and recognition of speech</orgName>
<orgName type="acronym">PAROLE</orgName>
<date type="end">2014-06-30</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/parole</ref>
</desc>
<listRelation><relation active="#struct-129671" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-423086" type="direct"></relation>
<relation active="#struct-206040" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
<tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno>
<orgName>INRIA Nancy - Grand Est</orgName>
<desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/nancy</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName>
<orgName type="acronym">LORIA - NLPKD</orgName>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref>
</desc>
<listRelation><relation active="#struct-206040" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno>
<idno type="RNSR">198912571S</idno>
<idno type="IdUnivLorraine">[UL]RSI--</idno>
<orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<date type="start">2012-01-01</date>
<desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-413289" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno>
<idno type="IdUnivLorraine">[UL]100--</idno>
<orgName>Université de Lorraine</orgName>
<orgName type="acronym">UL</orgName>
<date type="start">2012-01-01</date>
<desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.univ-lorraine.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="IdRef">02636817X</idno>
<idno type="ISNI">0000000122597504</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName><settlement type="city">Nancy</settlement>
<settlement type="city">Metz</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université de Lorraine</orgName>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">HAL</idno>
<idno type="RBID">Hal:hal-00734464</idno>
<idno type="halId">hal-00734464</idno>
<idno type="halUri">https://hal.inria.fr/hal-00734464</idno>
<idno type="url">https://hal.inria.fr/hal-00734464</idno>
<date when="2012-09-21">2012-09-21</date>
<idno type="wicri:Area/Hal/Corpus">005201</idno>
<idno type="wicri:Area/Hal/Curation">005201</idno>
<idno type="wicri:Area/Hal/Checkpoint">001559</idno>
<idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">001559</idno>
<idno type="wicri:Area/Main/Merge">001972</idno>
<idno type="wicri:Area/Main/Curation">001943</idno>
<idno type="wicri:Area/Main/Exploration">001943</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en">Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis</title>
<author><name sortKey="Steiner, Ingmar" sort="Steiner, Ingmar" uniqKey="Steiner I" first="Ingmar" last="Steiner">Ingmar Steiner</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-21766" status="VALID"><orgName>School of Computer Science and Informatics [Dublin]</orgName>
<desc><address><addrLine>UCD School of Computer Science & Informatics, University College Dublin, Belfield, Dublin 4</addrLine>
<country key="IE"></country>
</address>
<ref type="url">http://www.csi.ucd.ie/</ref>
</desc>
<listRelation><relation active="#struct-83934" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-83934" type="direct"><org type="institution" xml:id="struct-83934" status="VALID"><orgName>University College Dublin [Dublin]</orgName>
<orgName type="acronym">UCD</orgName>
<desc><address><addrLine>Belfield, Dublin 4</addrLine>
<country key="IE"></country>
</address>
<ref type="url">http://www.ucd.ie/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Irlande (pays)</country>
</affiliation>
</author>
<author><name sortKey="Richmond, Korin" sort="Richmond, Korin" uniqKey="Richmond K" first="Korin" last="Richmond">Korin Richmond</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-202842" status="VALID"><orgName>The Centre for Speech Technology Research [Edinburgh]</orgName>
<orgName type="acronym">CSTR</orgName>
<desc><address><addrLine>Informatics forum, 10 Crichton Street, Edinburgh, EH8 9AB</addrLine>
<country key="GB"></country>
</address>
</desc>
<listRelation><relation active="#struct-61277" type="direct"></relation>
</listRelation>
<tutelles><tutelle active="#struct-61277" type="direct"><org type="institution" xml:id="struct-61277" status="VALID"><orgName>University of Edinburgh</orgName>
<desc><address><addrLine>Old College South Bridge Edinburgh EH8 9YL</addrLine>
<country key="GB"></country>
</address>
<ref type="url">http://www.ed.ac.uk/home</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>Royaume-Uni</country>
<placeName><settlement type="city">Édimbourg</settlement>
<region type="country">Écosse</region>
</placeName>
<orgName type="university">Université d'Édimbourg</orgName>
</affiliation>
</author>
<author><name sortKey="Ouni, Slim" sort="Ouni, Slim" uniqKey="Ouni S" first="Slim" last="Ouni">Slim Ouni</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-205127" status="OLD"><idno type="RNSR">200118295L</idno>
<orgName>Analysis, perception and recognition of speech</orgName>
<orgName type="acronym">PAROLE</orgName>
<date type="end">2014-06-30</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/equipes/parole</ref>
</desc>
<listRelation><relation active="#struct-129671" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-423086" type="direct"></relation>
<relation active="#struct-206040" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
<tutelles><tutelle active="#struct-129671" type="direct"><org type="laboratory" xml:id="struct-129671" status="VALID"><idno type="RNSR">198618246Y</idno>
<orgName>INRIA Nancy - Grand Est</orgName>
<desc><address><addrLine>615 rue du Jardin Botanique 54600 Villers-lès-Nancy</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/nancy</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle active="#struct-423086" type="direct"><org type="department" xml:id="struct-423086" status="VALID"><orgName>Department of Natural Language Processing & Knowledge Discovery</orgName>
<orgName type="acronym">LORIA - NLPKD</orgName>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr/la-recherche-en/departements/Knowledge-and-Language-Management</ref>
</desc>
<listRelation><relation active="#struct-206040" type="direct"></relation>
<relation active="#struct-300009" type="indirect"></relation>
<relation active="#struct-413289" type="indirect"></relation>
<relation name="UMR7503" active="#struct-441569" type="indirect"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-206040" type="indirect"><org type="laboratory" xml:id="struct-206040" status="VALID"><idno type="IdRef">067077927</idno>
<idno type="RNSR">198912571S</idno>
<idno type="IdUnivLorraine">[UL]RSI--</idno>
<orgName>Laboratoire Lorrain de Recherche en Informatique et ses Applications</orgName>
<orgName type="acronym">LORIA</orgName>
<date type="start">2012-01-01</date>
<desc><address><addrLine>Campus Scientifique BP 239 54506 Vandoeuvre-lès-Nancy Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.loria.fr</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
<relation active="#struct-413289" type="direct"></relation>
<relation name="UMR7503" active="#struct-441569" type="direct"></relation>
</listRelation>
</org>
</tutelle>
<tutelle active="#struct-413289" type="indirect"><org type="institution" xml:id="struct-413289" status="VALID"><idno type="IdRef">157040569</idno>
<idno type="IdUnivLorraine">[UL]100--</idno>
<orgName>Université de Lorraine</orgName>
<orgName type="acronym">UL</orgName>
<date type="start">2012-01-01</date>
<desc><address><addrLine>34 cours Léopold - CS 25233 - 54052 Nancy cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.univ-lorraine.fr/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR7503" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID"><idno type="IdRef">02636817X</idno>
<idno type="ISNI">0000000122597504</idno>
<orgName>Centre National de la Recherche Scientifique</orgName>
<orgName type="acronym">CNRS</orgName>
<date type="start">1939-10-19</date>
<desc><address><country key="FR"></country>
</address>
<ref type="url">http://www.cnrs.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
<placeName><settlement type="city">Nancy</settlement>
<settlement type="city">Metz</settlement>
<region type="region" nuts="2">Grand Est</region>
<region type="old region" nuts="2">Lorraine (région)</region>
</placeName>
<orgName type="university">Université de Lorraine</orgName>
</affiliation>
</author>
</analytic>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">The importance of modeling speech articulation for high-quality audiovisual (AV) speech synthesis is widely acknowledged. Nevertheless, while state-of-the-art, data-driven approaches to facial animation can make use of sophisticated motion capture techniques, the animation of the intraoral articulators (viz. the tongue, jaw, and velum) typically makes use of simple rules or viseme morphing, in stark contrast to the otherwise high quality of facial modeling. Using appropriate speech production data could significantly improve the quality of articulatory animation for AV synthesis.</div>
</front>
</TEI>
<affiliations><list><country><li>France</li>
<li>Irlande (pays)</li>
<li>Royaume-Uni</li>
</country>
<region><li>Grand Est</li>
<li>Lorraine (région)</li>
<li>Écosse</li>
</region>
<settlement><li>Metz</li>
<li>Nancy</li>
<li>Édimbourg</li>
</settlement>
<orgName><li>Université d'Édimbourg</li>
<li>Université de Lorraine</li>
</orgName>
</list>
<tree><country name="Irlande (pays)"><noRegion><name sortKey="Steiner, Ingmar" sort="Steiner, Ingmar" uniqKey="Steiner I" first="Ingmar" last="Steiner">Ingmar Steiner</name>
</noRegion>
</country>
<country name="Royaume-Uni"><region name="Écosse"><name sortKey="Richmond, Korin" sort="Richmond, Korin" uniqKey="Richmond K" first="Korin" last="Richmond">Korin Richmond</name>
</region>
</country>
<country name="France"><region name="Grand Est"><name sortKey="Ouni, Slim" sort="Ouni, Slim" uniqKey="Ouni S" first="Slim" last="Ouni">Slim Ouni</name>
</region>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Lorraine/explor/InforLorV4/Data/Main/Exploration

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 001943 | SxmlIndent | more

HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 001943 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Lorraine
   |area=    InforLorV4
   |flux=    Main
   |étape=   Exploration
   |type=    RBID
   |clé=     Hal:hal-00734464
   |texte=   Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis
}}

This area was generated with Dilib version V0.6.33.
Data generation: Mon Jun 10 21:56:28 2019. Site generation: Fri Feb 25 15:29:27 2022

	Serveur d'exploration sur la recherche en informatique en Lorraine
	Attention, ce site est en cours de développement ! Attention, site généré par des moyens informatiques à partir de corpus bruts. Les informations ne sont donc pas validées.

Serveur d'exploration sur la recherche en informatique en Lorraine

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

Using multimodal speech production data to evaluate articulatory animation for audiovisual speech synthesis

Source :

Abstract

Links toward previous steps (curation, corpus...)

Le document en format XML

Pour manipuler ce document sous Unix (Dilib)

Pour mettre un lien sur cette page dans le réseau Wicri